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(57) Abstract: A method for testing the 
(Bit) Error Ratio BER of a device against a 
maxima] allowable (Bit) Error Ratio BERiinut 
with an early pass and/or early fail criterion, 
whereby the early pass and/or early fail 
criterion is allowed to be wrong only by a 
small probability D. ns bits of the output of 
the device are measured, thereby ne erroneous 
bits of these ns bits are detected. PDhigh 
and/or PDiow are obtained, whereby PDhigh 
is the worst possible likelihood distribution 
and PDiow is the best possible likelihood 
distribution containing the measured ne 
erroneous bits with the probability D. The 
average numbers of erroneous bits NE^igh 
and NEiow for PDhigh and PDiow are obtained. 
NEhigh and NEiow are compared with NEiimi, 
= BERiinut X ns. If NEiinui is higher than 
NEhigh or NEiimi, is lower than NEi^w the test 
is stopped. 
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Method for testing the Error Ratio of a Device 

The application is related to testing the (Bit) Error Ratio 
of a device, such as a digital receiver for mobile phones. 

5 

Concerning the state of the art, reference is made to US 
5,606,563. This document discloses a method of determining 
an error level of a data channel comprised of receiving 
channel parity error data indicating when bit errors occur 

10 within a set of data carried on the channel (channel error 
events) , successively integrating the channel error events 
data over successive accumulation periods, comparing the 
integrated channel error events data with a threshold, and 
indicating an alarm in the event the integrated channel 

15 error events data exceeds the threshold. 

Testing digital receivers is two fold: The receiver is 
offered a signal, usually accompanied with certain stress 
conditions. The receiver has to demodulate and to decode 

20 this signal. Due to stress conditions the result can be 
partly erroneous. The ratio of erroneously demodulated to 
correctly demodulated bits is measured in the Error Ratio 
test. The Bit Error Ratio BER test or more general any 
error rate test, for example Frame Error Ratio FER, Block 

25 Error Ratio BLER each comprising a Bit Error test, is 
subject of this application. 

BER testing is time consuming. This is illustrated by the 
following example: a frequently used BER limit is 0.001. 

30 The bitrate frequently used for this test is approx. 
lOkbit/s. Due to statistical relevance it is not enough to 
observe 1 error in 1000 *bits. It is usual to observe 
approx. 200 errors in 200 000 bits. This single BER test 
lasts 20 seconds. There are combined tests which contain 

35 this single BER test several times, e.g. the receiver 
blocking test . Within this test the single BER test is 
repeated 12750 times with different stress conditions. 
Total test time here is more than 70h. It is known in the 
state of the art to fail the DUT (Device Under Test) early 
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only, when a fixed number of errors as 200 errors are 
observed before 200 000 bits are applied. (Numbers from the 
example above) . 

5 It is the object of the present application to propose a 
method for testing the Bit Error Ratio of a device with 
reduced test time, preserving the statistical relevance. 

The object is solved by the features of claim 1 or claim 4. 

10 

According to the present invention, the worst possible 
likelihood distribution PDhigh and/or the best possible 
likelihood distribution PDiqw obtained by the formulas 

given in claim 1 and 4, respectively. From these likelihood 

15 distributions, the average number NE^igh NEiow is obtained 
and compared with the limit NEiij^it, respectively. If the 
limit NEiimit is higher than the average number NEhigh c>r 
smaller than the average number NEiow/ the test is stopped 
and it is decided that the device has early passed or early 

20 failed, respectively. 

The dependent claims contain further developments of the 
invention. 

25 The Poisson distribution preferably used for the present 
invention, is best adapted to the BER problem. The nature 
of the Bit Error occurrence is ideally described by the 
binomial distribution. This distribution, however, can 
only be handled for small number of bits and errors. For a 

30 high number of bits and a low Bit Error Ratio the binomial 
distribution is approximated by the Poisson distribution. 
This prerequisite (high number of bits, low BER) is ideally 
fulfilled for normal Bit Error Rate testing (BER limit 
0.001) as long as the DUT is not totally broken (BER 0.5). 

35 The application proposes to overcome problems with the 
discrete nature of the Poisson distribution*. With the same 
method an early pass condition as well as an early fail 
condition is derived. 
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An embodiment of the invention is described hereafter. In 
the drawings 

Fig. 1 shows a diagram to illustrate the inventive 
5 method, 

Fig. 2 shows the referenced Bit Error Ratio bernorm a 
function of the measured errors ne, 

10 Fig. 3 shows a diagram to illustrate a measurement using 
a first embodiment of the inventive method. 

Fig. 4 shows a diagram to illustrate a measurement using 
a second embodiment of the inventive method and 

15 

Fig. 5 shows a diagram illustrating the position at the 
end of the test using the first embodiment of the 
inventive method as a function of probability. 

20 In the following, the early fail condition and the early 
pass condition is derived with mathematical methods. 

Due to the nature of the test, namely discrete error 
events, the early stop conditions are declared not valid, 

25 when fractional errors < 1 are used to calculate the early 
stop limits. The application contains proposals, how to 
conduct the test at this undefined areas. The proposals are 
conservative (not risky) . A DUT on the limit does not 
achieve any early stop condition. The application proposes 

30 to stop the test unconditioned at a specific number K (for 
example 200 bit) errors. As this proposal contains a pseudo 
paradox, an additional proposal to resolve this pseudo 
paradox is appended. 

35 Based on a single measurement, a confidence range CR 
around this measurement is derived. It has the property 
that with high probability the final result can be found in 
this range. 
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The confidence range CR is compared with the specified BER 
limit. From the result a diagram is derived containing the 
early fail and the early pass condition. 

5 With a finite number of samples ns of measured bits, the 
final Bit Error Ratio BER cannot be determined exactly. 
Applying a finite number of samples ns, a number of errors 
ne is measured, ne/ns = ber is the preliminary Bit Error 
Ratio . 

10 

In a single test a finite number of measured bits ns is 
applied, and a number of errors ne is measured. ne is 
connected with a certain differential probability in the 
Poisson distribution. The probability and the position in 
15 the distribution conducting just one single test is not 
known . 

Repeating this test infinite times, applying repeatedly the 
same ns , the complete Poisson distribution is obtained. The 

20 average number (mean value) of errors is NE . NE/ns is the 
final BER. The Poisson distribution has the variable ne and 
is characterised by the parameter NE, the average or mean 
value. Real probabilities to find ne between two limits are 
calculated by integrating between such limits. The width of 

25 the Poisson distribution increases proportional to SQR(NE), 
that means, it increases absolutely, but decreases 
relatively. 

In a single test ns samples are applied and ne errors are 
30 measured. The result can be a member of different Poisson 
distributions each characterized by another parameter NE. 
Two of them are given as follows: 

The worst possible distribution NEh^gj^ , containing the 
35 measured ne with the probability Di, is given by 

nc 

" (1) 
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In the example Di is 0.002 = 0.2% PDhigh is the wanted Poisson 

distribution with the variable ni . ne is the measured 
number of errors. 

5 The best possible distributions NEi^^ , containing the 
measured ne with the probability D2 is given by 



10 



15 



25 



D2 -]PD,^^iNE,,^,ni)dm 



(2) 



In the example D2 is equal and it is D = Di = D2 = 

0 , 002=0 .2% . 



To illustrate the meaning of the range between NE^q^ and 
NEhigh refer to Fig. l. Fig. l shows the likelihood density 
PD as a function of the measured number of errors ne . In 
the example, the actual detected number of errors ne within 
the measured sample of ns bits is 10. The likelihood 
20 distribution of the errors is not known. The worst possible 
likelihood distribution PDhigh under all possible likelihood 
distributions as well as the best possible likelihood 
distribution PDiow under all possible likelihood 
distributions are shown. The worst possible likelihood 
distribution PDhigh is characterized in that the integral 
from 0 to ne = 10 gives a total probability of Di = 0.002. 
The best possible likelihood distribution PDiow is 
characterized in that the integral from ne = 10 to 00 gives 
a total probability of D2 = 0.002. In the preferred 
30 embodiment Dx is equal to D2 , i.e. D^ = D2 = 0.002 = 0.2%. 
After having obtained the likelihood distribution PDhigh and 
PDiow from formulas (1) and (2), the average values or mean 
values NEhigh for the likelihood distribution PDhigh and 
NEiow for the likelihood distribution PDiow can be obtained. 
35 The range between the mean value NEiow and NEhigh is the 
confidence range CR indicated in Fig. 1. 
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In the case the measured value ne is a rather untypical 
result (in the example just 0.2% probability) nevertheless 

the final result NE can still be found in this range, 
called confidence range CR. 

The probabilities Di and D2 in (1) and (2) can be 

independent, but preferable they are dependent and equal (D 
= Di = D2) . 



10 For the Poisson distribution NEiow eirid NEhigh can be 
obtained. With the formulas (3) and (4) respectively the 
inputs are the number of errors ne, measured in this test 
and the probabilities D and C = 1- D. The Output is NE, 
the parameter describing the average of the Poisson 

15 distribution. 

The following example is illustrated in Fig. 1 (d = Di = 
D2) : 

20 NE,^ = - — (3) 

NEni^H = ; (4 ) 



25 



30 



Example : 



Number of errors: ne=10 
Probability: D=0.002 C=0.998 



Result 



NEiow =3.26 
NEhigh = 22.98 

Interpretation : 

35 Having measured ne=10 errors in a single test, then with a 
low probability D=0.002 the average number of errors NE in 
this test is outside the range from 3.26 to 22.98 or with a 
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high probability C=0.998 inside this range from 3.26 to 
22 . 98 . 



Such as the width of the Poisson distribution, the 
5 confidence range CR increases proportional to SQR(ne), that 
means, it increases absolutely, but decreases relatively. 

If the entire confidence range CR, calculated from a single 
result ne, is found on the good side (NEiin^it > ^^high) of 
10 the specified limit NEiimit can state: With high 

probability C, the final result NE is better than the limit 
NEiimit- Whereby NEnmit is given by 



NEiiinit = BERiin^it • ns (5) 

15 

and BERiimit is the Bit Error Rate allowable for the device 
and obtained by an ideal long test with an infinite high 
number of bit samples ns. 



20 If the entire confidence range CR, calculated from a single 
result ne, is found on the bad side (NEiin^it < NEio^) of the 
specified limit NEiin^it can state; With high probability 
C, the final result NE is worse than the limit. 

25 With each new sample and/or error a new test is considered, 
reusing all former results. With each new test the 
preliminary data for ns, ne and ber is updated. For each 
new test the confidence range CR is calculated and checked 
against the test limit NEiimit • 

30 

Once the entire confidence range CR is found on the good 
side of the specified limit (NEii^it > N^high) / early pass 

is allowed. Once the entire confidence range CR is found on 
the bad side of the specified limit (NEii^it < NEio^y?) 
35 early fail is allowed. If the confidence range CR is found 
on both sides of the specified limit (NEiow < NEii^it < 
NEhigh) / it is evident neither to pass nor to fail the DUT 
early . 
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Fig. 1 illustrates the above conditions. Of course, NEnrnit 
is a fixed value not altering during the test, but NE^q^ and 
NEhigh well as the confidence range CR are altering 

during the test. For reasons of illustration, however, the 
) three possibilities of the possible positions of the 
confidence range CR with respect to the constant limit 
NEiimit drawn for the same example in Fig. 1. 

The above can be described by the following formulas: 

The current number of samples ns is calculated from the 
preliminary Bit Error Ratio ber and the preliminary number 
of errors ne 

15 ber = ne/ns (6) 

After a full test the final Bit Error Ratio is 

BERiimit = NEii^it / ns (7) 

for abbreviation in the formula: 



10 



20 



25 



35 



imit 

(normalised ber) (8) 



Early pass stipulates: 

NEhigh < NEii^it (9) 
30 Early fail stipulates: 
NEiow > NEi 

imit (10) 
Formula for the early pass limit: 



J ne 
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This is the lower curve (bernormpass (ne, C) ) in Fig. 2, 
which shows bernorm ^ function of ne . 

Formula for the early fail limit: 

5 

^^'-'m: '''' 

This is the upper curve (bernormfaii (ne, D) ) in Fig. 2. 

10 As the early pass limit is not defined for ne = 0 (normally 
the case at the very beginning of the test for a good DUT) , 
an artificial error event with the first sample can be 
introduced. When the first real error event occurs, the 
artificial error is replaced by this real one. This gives 

15 the shortest possible measurement time for an ideal good 
DUT. For example ns=5000 for BERiimit =0.001 and probability 
D=Di=D2=0.2%. 

As the early fail limit uses NEiqw < i for small ne<k (in 
20 the example below k=5) due to a decision problem at a 
fractional error, the early fail limit at ne=k is extended 
with a vertical line upwards. This ensures that a broken 
DUT hits the early fail limit in any case after a few 
samples, approx. 10 in the example. In other words, the 
25 test is not stopped as long as ne is smaller than k. 

With each new sample and/or error a new test is considered, 
reusing all former results. With each new test the 
preliminary data for ns, ne and ber and bernorm updated 

30 and a bernorm/^^ coordinate is entered into the bernorm' 
diagram. This is shown in Fig. 3. Once the trajectory 
crosses the early fail limit (bernorm (ne,D)) or the early 
pass limit (bernorm (ne,C)) the test may be stopped and the 
conclusion of early fail or early pass may be drawn based 

35 on this instant. 

Fig. 3 shows the curves for early fail and early pass, 
bernorm is shown as a function of the number of errors ne. 
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For the simple example demonstrated in Fig. 3, it is 
BERiiniit = 0-2 = 1/5 and the final Bit Error Ratio HER = 
0.25 (1/4). The test starts with the first bit sample, for 
which no error is detected. For the second sample, a first 
5 error is detected and the preliminary Bit Error Ratio ber = 
ne/ns = 1/2 and ber^orm ^ 

ber/BERi 

imit becomes 1/2 : 1/5 = 
5/2. bernorm after the second sample is marked with a cross 
a in Fig. 3. For the third, fourth and fifth sample, no 
further error occurs and bernorm subsequently becomes 5/3, 

10 5/4 and 5/5, respectively, which is marked with the crosses 
b, c and d in Fig. 3, respectively. The sixth sample brings 
a new error and ne becomes 2. Consequently, ber = ne/ns 
becomes 2/6 and bernorm becomes 10/6. This situation is 
marked with cross e in Fig. 3. For the seventh, eighth and 

15 ninth sample, no further error occurs and the situation 
after the seventh, eighth and ninth sample is marked with 
crosses f, g, h in Fig, 3, respectively. The tenth sample 
brings a third error. Consequently, ber becomes 3/10 and 
bernorm becomes 15/10. This situation is marked with cross i 

20 in Fig. 3. As can be seen from Fig. 3, the trajectory is 
between the early fail curve and the early pass curve at 
the beginning of the test, but converges to a line Zv which 
crosses the early fail curve after about forty ^errors . 
After forty errors, it can thus be decided that the/ tested 

25 DUT early fails the test. 

If no early stop occurs the BER test may be stopped, after 
the following condition is valid: 

30 ne >= K (13) 

and the DUT shall be passed, if ns is sufficiently high. K 
is a maximum number of errors. For example K can be 200. 

35 If the trajectory neither crosses the early fail curve nor 
the early pass curve after K (for example 200) errors have 
occurred, the DUT can be finally passed- If the DUT, 
however, is rather good or rather bad, the tests can be 
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stopped much earlier, long before the K = 200 errors have 

occurred. This significantly shortens the total test time. 

In the above embodiment early fail means: a DUT is failed 
5 and a probability of 0.2 % that it is actually better than 
the limit is accepted. Further early pass means: the DUT is 
passed and a probability of 0.2 % that it is actually worse 
than the limit is accepted. If the test is stopped at 2 00 
errors the DUT is passed without any early fail or early 

10 pass condition arbitrarily. It can cross the vertical 2 00 
error line in Fig. 2 at different heights, each height is 
connected with a certain statistical interpretation: The 
probability to have a DUT better (worse) than the limit is 
indicated in Fig. 5. The vertical in Fig. 5 shows the 

15 position in Fig. 2 at the end of the test. The horizontal 
in Fig. 5 shows the respective probability. 

This embodiment contains a pseudo paradox, due to 
statistical nature of the test and limited test time, 

20 demonstrated with the following example: A DUT, which is 
early failed, would pass if the probability for a wrong 
decision has been reduced by widening the early stop 
limits, or vice versa, if the test is stopped at 200 errors 
and the DUT is arbitrarily failed. A DUT, which is early 

25 passed, would fail if the probability for a wrong decision 
has been reduced. 

The following embodiment resolves this pseudo paradox and 
additionally accelerates the test. This is done by a 

30 meaningful redefinition of the early pass limit maintaining 
the early fail limit. Early pass means now: A DUT is passed 
and a probability of 0.2 % that it is actually worse than M 
times the specified limit (M > 1) is accepted. This is a 
worse DUT limit. This shifts the early pass limit upwards 

35 in Fig. 2 as shown in Fig. 4. Bernormp^ss (^^r C) in Fig. 2 
becomes bernormbadpass (ne, C) in Fig. 4. Bernormfaii (ne, D) 
remains unchanged. Now it is 

l^Eiimit,M = BERiiniit: ' M • ns (14) 
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and an early pass is allowed, if NEiimit * M = > 
NEhigh- 

5 There are three high level parameters for the test : 

- Probability to make a wrong decision (proposal: C= 0.2 %) 

- Final stop (proposal: K= 200 errors) 

- Definition of a Bad DUT (BERiimit ' M) 

10 These parameters are interdependent. It is possible to 
enter two of them and to calculate the third one. To make 
the test transparent, it is proposed to enter the wrong 
decision probability C and the final stop condition K and 
to derive the Bad DUT factor M. This is done in the 

15 following manner: The early pass limit is shifted upwards 
by a factor of M, such that the early fail and the early 
pass limit intersect at 200 errors in the example as shown 
in Fig. 4. Fig. 4 also shows the test limit obtained from 
the crossing point from the early fail curve and the easy 

20 pass curve, corresponding to Mtest • 

There are infinite possibilities to resolve the - above 
mentioned paradox. 

25 In the example above the open end between the limits was 
originally declared pass, and time was saved by multiplying 
the early pass limit with M (M>1) , shifting it upwards such 
that the early fail and the early pass curve intersect at 
200 errors (200: example from above). Such only a DUT, bad 

30 with high probability, is failed (customer risk) . 

The complementary method is: The open end between the 
limits is declared fail, and time is saved by multiplying 
the early fail limit with m (0<m<l) , shifting it downwards, 
35 such that the early fail and the early pass curve intersect 
at 200 errors (200: example from above) . Such only a DUT, 
good with high probability, is passed (manufacturer risk) . 
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Claims 

1, Method for testing the Error Ratio BER of a device 
5 against a maximal allowable Error Ratio BERiir^^^ with an 

early pass criterion, whereby the early pass criterion is 
allowed to be wrong only by a small probability D^, with the 
following steps 

- measuring ns bits of the output of the device, thereby 
10 detecting ne erroneous bits of these ns bits, 

assuming that the likelihood distribution giving the 
distribution of the number of erroneous bits ni in a fixed 
number of samples of bits is PD{NE,ni), wherein NE is the 
average number of erroneous bits, obtaining PDhigh from 

15 

ne 
0 

wherein PDhigh is the worst possible likelihood distribution 
containing the measured ne erroneous bits with the 
20 probability Di , 

- obtaining the average number of erroneous bits NEhigh for 
the worst possible likelihood distribution PD^igh* 

- comparing NEhigh with NEii^it = BERii^it * ns, 

- if NEiiniit is higher than NEhigh stopping the test and 
25 deciding that the device has early passed the test and 

if NEiijnit is smaller than NEhigh continuing the test 
whereby increasing ns . 

2. Method for testing the Error Ratio BER according to 
30 claim 1, 

characterized in that 

the likelihood distribution PD(NE,ni) is the Poisson 
distribution . 

35 3 . Method for testing the Error Ratio BER according to 
claim 1 or 2, 
characterized in that 
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for avoiding a undefined situation for ne=o starting the 
test w.th an artificial error ne-i not incrementing ne then 
a first error occurs. 

4. Method for testing the Error Ratio BER of a device 

against a maximal allowable Error Ratio BER, 

i-^-ii • «^<ii:io BERii^i^ with an 

early farl criterion, whereby the early fail criterion is 
allowed to be wrong only by a small probability D„ with the 
following steps ^ ' i-xie 



15 



- measuring „s bits of the output of the device, thereby 
detecting ne erroneous bits of these ns bits 

- assuming that the likelihood distribution giving the 
d.strrbut.on of the number of erroneous bits ni in a fill 
number o, samples of bits is Pr„»E,ni,, wherein «E is the 
average number of erroneous bits, obtaining PDi„„ from the 

CO 

°2 'jPD^(ffE^,n)am 



Wherein PDi„„ is the best possible litelihood distribution 
20 contarnrng the measured ne erroneous bits with the 
probability D2 , 

- obtaining the average number of erroneous bits NE^ for 
the best possible likelihood distribution pd, '^'^ 

- comparing NE^^w with ^E^,^,, = BER^,^,, ■ ns, 

'^J^-'^^^'T '"""'"^ ""^^^ stopping the test and 

deciding that the device has early failed the test and 
; NEii^i, .s higher than NE,,„ continuing the test- whereby 
increasing ns . 

characterized in that 

diltr^bu'ttr" - the Porsson 

35 

6. Method for testing the Error Ratio BER ^nnr. ^• 
claim 4 or 5, according to 

characterized in that 
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for avoiding a undefined situation for ne<k, wherein k is a 
small number of errors, not stopping the test as long as ne 
is smaller than k. 

5 7. Method for testing the Error Ratio BER according to 
claim 6, 

characterized in that 

k is 5 . 

10 8. Method for testing the Error Ratio BER according to any 
of claims 4 to 7, 
characterized by 

an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 

15 probability Dx, with the following additional steps 

assuming that the likelihood distribution giving the 
distribution of the number of erroneous bits ni in a fixed 
number of samples of bits is PD(NE,ni), wherein NE is the 
average number of erroneous bits, obtaining PD^igh from 

20 , 

ne 

0 

wherein PD^^igh is the worst possible likelihood distribution 
containing the measured ne erroneous bits with the 
25 probability Dx, 

- obtaining the average number of erroneous bits NEhigh for 
the worst possible likelihood distribution PDhigh* 

- comparing NEhigh with NEximit = BERximit " ns, 

- if NExitnit is higher than NEhigh stopping the test and 
30 deciding that the device has early passed the test and 

if NEximit is smaller than NEhigh continuing the test, 
whereby increasing ns. 

9. Method for testing the Error Ratio BER according to 
35 claim 8, 

characterized in that 
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for avoiding a undefined situation for ne=0 starting the 
test with an artificial error ne=l not incrementing ne then 
a first error occurs. 

5 10. Method for testing the Error Ratio BER according to 
claim 8 or 9, 
characterized in that 

the probability for the wrong early pass criterion and 

the probability D2 for the wrong early fail criterion are 
10 equal (Di=D2) . 

11. Method for testing the Error Ratio BER according to any 
of claims 4 to 7, 
characterized by 

15 an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 
probability Di , with the following additional steps 

assuming that the likelihood distribution giving the 
distribution of the number of erroneous bits ni in a fixed 

20 number of samples of bits is PD(NE,ni), wherein NE is the 
average number of erroneous bits, obtaining PDhigh from 

ne 
0 

25 wherein PDhigh is the worst possible likelihood distribution 
containing the measured ne erroneous bits with the 
probability Di, 

- obtaining the average number of erroneous bits NEhigh for 
the worst possible likelihood distribution PDhigh/ 

30 - comparing NEhigh with NEiimit,M = BERii^it • M ■ ns, with 
M > 1 

- if NEiin^it^M is higher than NEhigh stopping the test and 
deciding that the device has early passed the test and 

- if NEiii^it^M is smaller than NEhigh continuing the test, 
35 whereby increasing ns . 
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